TAD LAB 



CNN Workshop Final Project 


Introduction 


In this project, you will implement a Deep learning classifier using both a fully 
connected (FC) model and a convolutional neural net (CNN) model and 
compare between them using Keras. 


The dataset you will use is CIFAR-10. This dataset consists of 60K images in 10 
classes, 6K images per class. The dataset is split into 50K images for training 
and 10K for testing. 
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Figure 1: Samples of the dataset 

So far, we have been dealing with grayscale images with simple features 
(MNIST, Fashion MNIST). So, CIFAR-10 will propose some challenges that will 
require you to use most of the techniques discussed in the sessions such as 
transfer learning, data augmentation, etc. 


































The code flow 

1. First, learn how to import the dataset into your notebook 
Hint: https://keras.io/datasets/ 

2. Visualize some of the images 


3. Data preprocessing: this step includes normalization, data augmentation, 
flattening (for the FC model) 

Hint: https://keras.io/preprocessing/image/ 

Also, refer to this tutorial to know about more augmentation techniques 
https://machinelearningmasterv.com/image-augmentation-deep-learning- 

keras/ 

Augmented Images 
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Figure 2: An example of data augmentation 


4. Model definition: Here you will define two models an FC model and a 
CNN model. Please note that CNN doesn’t require flattening the image. 
You will also decide on the optimizer, weight initialization method, and 
hyper-parameters 

You can also use a pre-trained model (Transfer learning). 

Hint: https://towardsdatascience.com/keras-transfer-learning-for-beginners- 

6c9b8b7143e 

Note the difference between the size of CIFAR-10 images (32x32) and the 
expected input size of the pre-trained model (224x224) 
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Figure 3: Freezing (not training) early layers during transfer learning 

5. Visualize the loss, accuracy over iterations and plot the confusion matrix. 
Also, visualize some of the incorrectly classified images. 

General hints: 

Try tuning several hyperparameters such as the learning rate, learning rate 
decay technique, batch size, number of epochs, etc. Don’t use the default 
values. 

Training the model on your device might take a long time, use Google Colab 
instead. 

Refer to the MNIST code uploaded on the group, your code should be very 
similar to it. 
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